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Analysis of successive data sets 



The invention relates to a method of analyzing successive data sets, in which 
the individual data sets comprise data elements which assign data values to spatial positions. 

A method of this kind is known from United States patent US 5 431 161. 

The known method utilizes data sets acquired by means of a Single Photon 
Emission Computed Tomography (SPECT) imaging method. The known method is intended 
notably for the diagnosis of cardiac diseases, notably diseases of the coronary arteries. The 
SPECT imaging method is used to form SPECT images of cross-sections of the heart of a 
patient to be examined. Subsequently, the user of the known method has to select regions of 
interest from the SPECT images by hand. The regions of interest are notably the parts of the 
SPECT images which relate to the myocardium (the heart muscle). The known method 
subsequently determines the perfusion of the myocardium so as to obtain an idea of the 
degree of perfusion of the cardiac muscle. To this end, the ratio of the mean brightnesses of 
the brightest part of the SPECT images is determined in the end systolic phase and the end 
diastolic phase of the heart to be examined. 

It is an object of the invention to provide a method which enables more 
accurate analysis of the data sets. It is notably an object of the invention to provide a method 
which enables more exact localization of the region of interest in the successive data sets. 

This object is achieved by means of a method of analyzing successive data 

sets, in which 

- a local intensity variation [I(x,t)] is established from data values in successive data sets in 
corresponding spatial positions, and 

- on the basis of the local intensity variation a region of interest is localized from one or 
more of the successive data sets, 

- the local intensity variation in the region of interest is in conformity with a predetermined 

property. 

In accordance with the invention the region of interest is localized in the 

successive data sets on the basis of the local intensity variation of the data values in the data 
sets. The invention can be advantageously used in particular when each of the data sets 
represents an image of an object to be examined. In that case the data values are brightness 
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values or grey values of the pixels of the image. The invention, however, can also be used 
when the data values represent the local value of a physical quantity; such a quantity may be, 
for example, the temperature, pressure, concentrations of given substances and so on. The 
intensity variation represents the variations of data values in successive data sets in 
5 corresponding positions. For example, when the data sets succeed one another in time, the 
intensity variation represents the variation in time of the data values in corresponding 
positions. The invention can be advantageously used, for example, for magnetic resonance 
perfusion imaging methods; the successive data sets then relate to successive phases of a 
perfusion process. The data sets are then acquired by reconstruction from magnetic resonance 
1 0 signals acquired during the successive phases of the perfusion process while utilizing a 

perfosion-sensitive magnetic resonance imaging method. The approach in accordance with 
the invention is based on the recognition of the fact that a difference exists between the 
variation in time of the data values in the region of interest and that of the data values outside 
the region of interest. It even often happens that a given characteristic intensity variation 
1 5 occurs in the region of interest. It has been found that such a characteristic intensity variation 
can be readily localized, that is, in particular by comparing the instantaneous intensity 
variation with a predetermined intensity variation. It usually suffices to limit this comparison 

O to one or a few characteristic properties of the intensity variation. 

n I 

These and other aspects of the invention will be described in detail hereinafter 
20 on the basis of the following embodiments which are defined in the dependent claims. 

The local intensity variation is preferably established for different blocks 
which relate to large or small spatial regions, but preferably comprise a plurality of data 
values of the individual data sets. This step is preferably taken in situations in which the local 
intensity variation changes significantly across significant spatial distances but only slightly 
25 across shorter distances. Consequently, it is not necessary to determine the local intensity 
variation for each of the individual spatial positions, so that the number of calculations 
required so as to obtain the local intensity variation is limited. The size of the blocks 
preferably amounts to approximately the distance over which significant differences occur in 
the local intensity variation. Suitable results are obtained by means of non-overlapping 
30 blocks of approximately 32 x 32 image elements (pixels). The locally averaged local intensity 
variation in these individual blocks is calculated. To this end, respective local mean values of 
the data values are calculated in the individual data sets in the individual blocks. The local 
mean intensity variation is derived from said local mean data values. The local mean data 
values are obtained for each block in the individual data sets by filtering while using, for 



- 



PHNL010107 

3 24.01.2002 
example, a Gaussian profile. Incidental fluctuations, such as caused by noise, are thus 
prevented from affecting the localization of the region of interest. 

The time derivative of the local intensity variation constitutes a suitable 
characteristic property of the local intensity variation. In many situations the time derivative 
of the local intensity variation in the region of interest is clearly distinct from the time 
derivative of the local intensity variation outside the region of interest. The time derivative of 
the local intensity variation is notably very suitable for use in cardiology. A variety of 
radiological techniques, such as magnetic resonance angiography, X-ray angiography or 
computed tomography angiography, enable the acquisition of successive data sets in which 
the heart of a patient to be examined is imaged. The data values in the data set then represent 
local intensity values in the angiographic image. Such an image concerns, for example, a 
cross-section of the heart of the patient to be examined, but it is also possible to form a 
spatial (three-dimensional) image of the heart of the patient to be examined. In these 
applications regions of interest are, for example, the parts in the data sets which relate to the 
left ventricle and to the right ventricle and to the myocardium of the heart of the patient to be 
examined. Furthermore, a contrast medium is administered to the patient for the acquisition 
of the data sets. The local intensity variation then represents the passage of blood with the 
contrast medium through the individual anatomical parts of the heart of the patient to be 
examined. Furthermore, considerable differences exist between the local intensity variations 
in the individual anatomical parts of the heart. For example, first a significant fast increase of 
the intensity occurs, succeeded by a somewhat slower decrease of the intensity in the left 
ventricle. Such an intensity profile also occurs in the right ventricle, be it with a given time 
delay, and this intensity profile occurs even later in the myocardium, be it with less strong 
variations in time of the intensity. In accordance with the invention the left and right 
ventricles and the myocardium can thus be localized accurately and automatically on the 
basis of an angiographic (cardio) data set. 

Considerable differences occur notably between the time derivatives of the 
local intensity profile in the left ventricle and in the right ventricle, respectively, the 
myocardium and the region outside the heart of the patient to be examined. Consequently, the 
time derivative of the local intensity variation is very suitable for accurately and 
automatically localizing the left and right ventricles and the myocardium from an 
angiographic (cardio) data set. 

It is notably possible to localize the region of interest on the basis of blocks of data elements 
in which the variations of the local intensity variation, for example, the time derivative of the 
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local intensity variation, exceed a predetermined ceiling value and/or are smaller than a 
predetermined bottom value. In the cardiological application of angiography in particular, for 
example, the left ventricle and the right ventricle can be localized in this manner. In the left 
ventricle and the right ventricle a fast, significant increase takes place, followed by a 
significant decrease of the local intensity; this means that the ceiling value is exceeded by the 
time derivative of the local intensity variation, followed by a value of the time derivative 
which is lower than the bottom value. This bottom value is preferably negative. Parts in the 
data sets in which a decreasing intensity variation occurs can thus be localized. Such a 
decreasing intensity variation occurs, for example, because the concentration of contrast 
medium in the blood in the heart of the patient to be examined decreases after the passage of 
a contrast bolus. In practice it often suffices to localize only the left and the right ventricle 
from the successive data sets on the basis of the time derivative of the local intensity 
variation. The myocardium can subsequently be localized on the basis of the position of the 
left ventricle and that of the right ventricle which have meanwhile been determined. 

In accordance with the invention the local intensity variation can be used to 
classify the data elements as belonging to the region of interest or not. For example, because 
values of the time derivative occur which exceed the ceiling values and also negative values 
of the time derivative which are below the bottom value, data elements can be readily 
classified as belonging to the left ventricle or to the right ventricle. 

In a further advantageous implementation of the method in accordance with 
the invention the local intensity variation is compared with a reference intensity variation for 
the region of interest. Such a mean intensity variation is determined in advance, for example, 
empirically. For example, the intensity variations in the left and right ventricles and the 
myocardium are empirically determined for a large number of patients. For the individual 
parts of the heart individual mean intensity variations are formed from such empirically 
determined intensity variations. Such mean intensity variations can be suitably used as a 
reference. 

It has been found that the comparison of the local intensity variation and the 
reference intensity variation can be accurately performed by comparing the time derivative of 
the local intensity variation with the time derivative of the reference intensity variation. 

The data elements can be accurately classified without requiring much 

calculation work by comparing the local intensity variation for the relevant data element with 
the reference intensity variation. For example, the comparison is performed by calculating the 
correlation between the local intensity variation and the reference intensity variation. This 
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comparison can be performed accurately and quantitatively in particular by means of a 
similarity measure. Such a similarity measure indicates the degree of correspondence 
between the local intensity variation and the reference intensity variation. 

In an advantageous implementation of the method in accordance with the 
5 invention strong spatial gradients of data values are masked in parts of the data sets. In this 
context the term "mask" is to be understood to mean that such strong spatial gradients are 
omitted or ignored for the further operations. Such strong spatial gradients, in conjunction 
with the consequences of motion, for example, during the acquisition of the data values, may 
give rise to significant artificial temporal gradients. When parts in the individual data sets 
K 10 with strong spatial gradients of the data values are masked, the adverse effects of such 
O artificial temporal gradients on the localization of the region of interest are avoided. Masking 

\xk is performed, for example, by calculating local mean gradients in the data set and subtracting 

the local mean gradients from the data values in the data sets. In circumstances where it is 
known in advance that the region of interest itself is (also) characterized by strong spatial 
1 5 gradients, this aspect can be taken into account. For example, in the case of MR angiography 
with perfusion, masking is limited to the data sets prior to the occurrence of perfusion and/or 
after termination of the perfusion. 

Preferably, the data sets are mutually corrected for phenomena which are due 
to motion, for example, during the acquisition of the data set. Such a correction is also 
20 referred to as "mutual registration". Shifts in time are performed in successive data sets, that 
is, the spatial positions whereto the data values are assigned are adapted in such a manner 
that corresponding parts in successive data sets are situated each time in the same spatial 
positions. Such corresponding parts relate, for example, each time to one and the same (part 
of an) object reproduced by the data set at successive moments in time. 
25 The method in accordance with the invention is also suitable for localizing a 

plurality of different regions of interest from the successive data sets. It is notably possible to 
localize different regions of interest where differences exist between the local intensity 
variations in such different regions. This occurs notably in cardiological angiography in 
which the successive data sets relate to the passage of blood with contrast medium through 
30 the left ventricle and the right ventricle and the myocardium of the heart of the patient to be 
examined. Such individual regions of interest are accurately localized by means of the 
method in accordance with the invention. The corresponding regions of interest in the 
individual data sets are preferably mutually registered so as to correct for artificial 
phenomena that are caused by motions, such as the beating of the heart and respiration of the 
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patient to be examined. In conformity with an advantageous implementation of the method in 
accordance with the invention maximum intensity projections are formed in a direction of 
succession through the successive data sets of the individual spatial regions of interest that 
have already been localized. Differences between such individual maximum intensity 
5 projections constitute feature images in which each time one of the regions of interest is 

reproduced in an intensified manner. It is notably possible to reproduce individual regions of 
interest in an intensified manner relative to other localized regions of interest in situations in 
which the individual regions of interest exhibit each time a similar intensity variation, be it 
with a delay in time. Such a situation occurs notably in cardiological angiography where 

10 perfusion of blood with contrast medium first takes place through the right ventricle, and 
subsequently through the left ventricle and ultimately through the myocardium. When a 
maximum intensity projection through the successive data sets of the left ventricle and the 
right ventricle is formed in the period of time between the passage through the left ventricle 
and the right ventricle, that is, of the regions relating to the left ventricle and the right 

15 ventricle, and when this projection is subtracted from another maximum intensity projection, 
at an instant after the passage through the left ventricle, through the successive data sets of 
the regions of interest that relate to the left ventricle, a feature image is formed in which the 
left ventricle and the myocardium are reproduced in an intensified fashion. 
It has been found that the general shape of the region of interest is often known in advance, 

20 notably in the case of cardiological applications; for example, the region of interest has a 
more or less round shape. The boundary can be easily derived from the feature image while 
utilizing the general shape that is known in advance. Notably interpolation with a restriction 
to the known shape is suitable for this purpose. Interpolation on the basis of a so-called 
statistical shape model is also suitable to determine the boundary. Such a statistical shape 

25 model is known per se from T.F. Cooten et al. "Active shape models - their training and 
application", Comp. Vis. Image Underst. 61(1):38:59, 1995. and also from A.D. Brett and 
C.J. Taylor, "Automated construction of 3D shape models using harmonic maps", in Medical 
Image Understanding and Analysis, London, July 2000, pp. 175 to 178. 

The edge of the region of interest can be readily localized by transforming the 

30 feature image, in which the round region of interest is reproduced in intensified form, to pole 
co-ordinates. Preferably, the origin of the pole co-ordinate system is chosen to be situated at 
the center of the round region in the feature image. The edge of the region of interest appears 
as a distinct transition in the data values in the feature image that has been transformed to 
pole co-ordinates; this transition appears as a straight edge in a rendition. Such a straight edge 
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can be readily localized. Thus, in particular it is easy to localize the region of the 
myocardium exactly in the feature image. Subsequently, the local perfusion of the 
myocardium can be studied. 

In an advantageous implementation of the invention a mask is derived for one 
5 or more of the individual data sets, that is, on the basis of the time derivative of the local 
intensity variation. Values for the mask are determined for individual spatial positions and 
from the value of the time derivative of the local intensity variation at the area of the relevant 
spatial position in the individual data set. Such a mask is used to segment the region of 
interest from the relevant data set. For example, the mask is formed as a binary data set. The 
q 1 0 segmentation is then performed by retaining in the relevant data set the data values for spatial 
H positions for which the mask has the same value, for example the value 1 . The mask can be 

|U obtained simply by applying a threshold filter to the time derivative of the local intensity 

Jj variation, so that only the values of the time derivative of the local intensity variation which 

*F are larger or smaller than a predetermined limit value are retained for the relevant data set. 

O 15 In a further advantageous implementation of the invention the spatial 

distribution of the time derivative of the local intensity variation is reproduced as an image 
for one or more of the data sets. Notably the value of the maximum of the time derivative of 
the local intensity variation is shown at the relevant spatial position or for the relevant block. 
Such an image is also referred to as an "upslope map". The foregoing can be carried out very 
20 well by utilizing so-called false colors; in that case the color values represent the local value 
of the time derivative of the local intensity variation. In cardiological applications such an 
upslope map is preferably formed for the region of interest relating to the myocardium. This 
upslope map is a suitable rendition of the perfusion of the myocardium and hence constitutes 
a suitable technical aid for the cardiologist for localizing infarcted regions and the extent of 
25 the infarction. 

The invention also relates to an analysis system for carrying out the method in 
accordance with the invention. Such an analysis system in accordance with the invention is 
defined in claim 16. An analysis system of this kind is preferably configured as a medical 
diagnostic workstation. The invention also relates to a computer program for analyzing 
30 successive data sets. Such a computer program in accordance with the invention is defined in 
claim 17. For example, a computer program in accordance with the invention can be loaded 
into the memory of an analysis system, for example, a medical diagnostic workstation. The 
computer program in accordance with the invention can be stored on a data carrier, for 
example, a CD-ROM disc, and be downloaded into the memory of the analysis system from 
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the data carrier. It is also possible to download the computer program from a network such as 
the "world-wide web". 

These and other aspects of the invention will be described in detail hereinafter, 
by way of example, on the basis of the following embodiments and with reference to the 
accompanying drawing; therein 

Fig. 1 shows an example of successive data sets whereto the invention is 



applied, 



Fig. 2 shows examples of the local intensity variation, 

Fig. 3 shows examples of the time derivative of the local intensity variation, 



K 10 and 



O Fig. 4 shows an example of an upslope map. 

jU Fig. 1 shows an example of successive data sets whereto the invention is 

2r; applied. Each of the data sets la, lb, 1c and Id in Fig. 1 represents an image of a cross- 

•P section of the heart 1 0 of the patient to be examined. These images are notably magnetic 

q 1 5 resonance images or CT images. The data sets, or images, in the example of Fig. lare 
Jif successive in time, that is, the image lb succeeds the image la while the image 1c succeeds 

OS the image lb and the image Id succeeds the image Ic.Only four data sets are shown for 

ST: simplicity of the Figure, but many tens or hundreds of successive data sets may be used in 

practice. 

20 Each time blocks 3a, 3b, 3c, 3d of data values are taken in the data sets. In Fig. 1 each time 
one of the blocks is shown in each of the data sets; in particular, the block 3a, 3b, 3c, 3d 
shown is situated at the area of the left ventricle 11 of the heart lO.The weighted mean data 
value is calculated for each of the blocks 3a, 3b, 3c, 3d by Gaussian filtering. The local 
intensity variation is obtained for the blocks 3a, 3b, 3c, 3d by plotting said weighted mean 

25 values as a function of time; this is represented by the solid curve 12 in Fig. 2. Therein, the 
sequence number of the successive data sets, or images (also referred to as frames), is plotted 
along the time axis. As appears from Fig. 2, and also from Fig. 3, successive data sets with 
more than 60 individual data sets or images are used for the present example. The local 
intensity variation 12 as shown in Fig. 2 exhibits a strong maximum which corresponds to the 

30 bolus passage through the left ventricle. The dashed curve 13 in Fig. 2 represents the local 
intensity variation at the area of the right ventricle. The maximum of the local mean data 
values now occurs only at approximately the 50 th frame, because the contrast bolus traverses 
the right ventricle later than the left ventricle. 
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Fig. 3 shows the time derivatives 21, 22 of the local intensity variation. Each 
of the time derivatives 21, 22 has the property that a high positive maximum is succeeded by 
a strong negative minimum. The local intensity variations at the area of the left ventricle and 
the right ventricle can be readily localized on the basis of this property. For the purpose of 
5 comparison a dash-dot line is plotted so as to represent the local intensity variation outside 
the heart, in this case being the brightness value, that is, the data value which is 
approximately constant in the map. 

In accordance with the invention the local intensity variation is determined for many blocks 
in each of the data sets, that is, by comparison with a reference. This comparison is carried 
h 10 out, for example, while utilizing the similarity measure. To this end, an overlap of the time 
H derivative of the relevant local intensity variation p and the time derivatives of the reference 

H intensity variation q is determined: 

ear 

J min <>end ; ? end ) ~ maX 0?start > ffstart ) 

£ 0= maxO end -/W « ) 

^ 0 Oend ^ tfstart'tfend ^ Atart) 

If Therein, the subscripts "end" and "start" indicate the selected end instant and start instant of 

5 1 5 the local intensity variation and the reference intensity variation. The overlap O is zero when 

3 the local intensity variation commences before or terminates after the reference intensity 

i \ 

variation. The overlap indicates to what extent the support of the local intensity variation in 
the successive data sets, for example, in time, coincides with the support of the reference 
intensity variation. A suitable similarity measure is: 
20 S^H(0^0^)H(t mSK -^Xp. -AnJ 

0 x<0 

Therein, H is the heavy side step function: H (x) = , and p max and p min are the values 

1 jc>0 

of the local maximum and the local minimum in the time derivative of the local intensity 
variation. In the case of the application for cardiology, this maximum and minimum relate to 
the arrival of the contrast bolus and the departure of the contrast bolus, respectively. The 

25 parameter O m i n is a minimum overlap with the time derivative of the reference intensity 

variation. The similarity measure S takes into account the fact that the minimum succeeds the 
maximum in the time derivative of the local intensity variation. Using the similarity measure, 
data values in the data sets or pixels in the successive images are classified as belonging to 
the region of interest, for example, the image of the left ventricle. 

30 Fig. 4 shows an example of an upslope map. This upslope map concerns the 

myocardium. Therein, the part of the myocardium which is reproduced in the images is 
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localized in advance as the region of interest. Subsequently, the value of the maximum of the 
time derivative of the local intensity variation is locally reproduced as a "false" color or grey 
value in the image of the myocardium. It is clearly shown that there are parts 3 1 with a 
suitable perfusion; in these parts rather high maximum values of the time derivative of the 
local intensity variation occur. In other regions 32 the perfusion obviously is less good, 
because in these regions the maximum values reached for the time derivative are not as high 
by far. 



